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I.  INTRODUCTION 


The  objective  of  this  research  effort  was  to  determine  the  opti- 
mum frequencies  at  which  a radar  should  be  operated  to  obtain  reliable 
aircraft  classification.  Previous  efforts  established  the  range  of  fre- 
quencies which  should  be  utilized  to  accomplish  such  classification.*" 

5 

In  previously  reported  results  a set  of  harmonically  related  fre- 
quencies were  used  ranging  in  number  from  12  down  to  4,  where  the  4 
frequencies  were  picked  in  the  range  most  strongly  contributing  to  the 
reduction  of  classification  errors.  The  present  effort  was  motivated 
by  the  realization  that  the  frequency  parameter  is  the  most  costly  and 
its  use  should  therefore  be  minimized.  The  objective  was  thus  explic- 
itely  set,  first  to  find  the  optimum  single  frequency  of  operation  if 
only  one  frequency  were  permitted,  and  determine  the  minimum  classifi- 
cation error  achievable  when  all  other  scattering  parameters  associated 
with  that  frequency  were  utilized.  Next,  a two  frequency  exhaustive 
search  was  performed  to  obtain  the  frequency  combination  that  would 
assure  the  minimum  classification  error.  It  was  found  that  by  utilizing 
two  frequencies  the  error  levels  were  sufficiently  low  so  that  the  intro 
duction  of  additional  frequencies  was  not  warranted.  The  range  of  fre- 
quencies used  was  between  2 MHz  and  24  MHz  with  the  lower  bound  set 
by  the  largest  airplane,  the  Bl.  The  search  for  optimum  frequencies 
was  carried  out  in  increments  of  2 MHz. 

Previously  published  results  dealt  with  four  airplanes  of  similar 
size,  F104,  F4,  Mi g 19  and  Mi g 21.  To  provide  a more  realistically 
representative  set  of  airplane  classes,  four  additional  airplanes  were 
introduced  that  substantially  increased  the  range  of  sizes  and  shapes, 
they  were,  F14,  Mig  25,  SR  71  and  Bl. 

The  classification  algorithm  used  in  this  work  is  the  Nearest  Neigh 
bor-rule.  This  choice  was  made  due  to  both  its  nonparametric  nature 


and  Us  effectiveness  in  cases  where  the  different,  classes  are  distrib- 
uted on  rather  convolved  surfaces  with  relatively  close  proximity  to 
each  other. 

Section  11  discusses  decision  rules.  Section  III  describes  the 
various  features  available  for  the  aircraft  classification  process. 
Section  IV  discusses  the  noise  model  chosen  for  contaminating  the  learn- 
ing sets  to  produce  test  sets,  Section  V describes  the  method  through 
which  test  sets  were  produced  and  misclassif ication  probabilities  com- 
puted. Sections  VI  through  IX  present  the  performance  results  obtained 
by  utilizing  feature  vectors  of  increasing  dimensional ity  ranging  from 
single  frequency  amplitude  returns  through  two  frequency  complex  returns. 


II.  DECISION  RULES 


When  the  statistical  nature  of  the  corrupting  noise  is  known  the 
optimum  decision  rule  is  that  of  Bayes,  where  the  misclassif ication 
probability  is  minimized.  The  average  probability  of  error  associated 
with  returns  from  class  is 


Pk(i)  (I  - / P( x | a*j)dx] 
xrRk 


(1) 


k 

where  denotes  the  numher  of  discrete  points, a.  representing  the  class 
and  R^  denotes  the  region  of  n-space  associated  with  the  decision 
rule  for  choosing  class  C^  given  Nk  sample  vectors  a*j,  Pk ( i ^ denotes 
the  a priori  probability  of  occurrence  of  a*?.  The  regions  R^  are  dis- 
joint and  jointly  occupy  the  entire  x domain. 

Let  K be  the  numher  of  classes  or  objects  to  be  distinguished  and 
P(C^)  denote  the  a priori  probability  of  each  class,  the  average  proba- 
bility of  misclassif icaiton  of  the  overall  system  would  be 


I 


? 


(2 


Combining  (1),  (2)  and  assuming  P. (i)  * i-  , we  have 


K Nk  x 

= 1 ’ V pfck)fF-  V f P(x|a^)dx) 

k=l  k \ \ 1-1  xcR,  1 / 


(3' 


Bayes  rule  is  set  up  to  minimize  the  above  by  adjusting  Rk  such  that 

N, 


K / i k . \ 

V max  P(C.)  ^ y / P(x|ak)dx  , 
<=1  K ' \ 1-1  xeR,  1 J 


(4, 


or  in  another  notation 


Pp  = 1 - / maxk  P(Ck)  P(x|^T  dx 


(5) 


where  the  integral  is  carried  out  over  the  entire  x domain  and 
N, 


P(x|ak)  = 1-  l P(x|ak) 
\ 1=1  1 


(61 


is  the  average  class-conditional  probability  density  function. 


For  the  following  special  conditions 
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m p(ck)  ■ i . 


(7) 


I?)  There  is  only  one  point  in  each  class,  i.e.. 
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one  chooses  class  Cr  when  P(x|Cr)  is  the  maximum,  i.e., 

if  P ( x I C ) = max.  P ( x I C . ) , choose  C (91 

r it  r 

If  the  corrupted  noise  is  additive  gaussian,  the  point  ar  which 
is  at  the  minimum  distance  to  the  tested  vector  x yields  the  maximum 
P ( x ) C i 1 , and  Bayes  rule  becomes  equivalent  to  an  N.N.  classifier,  i.e., 

if  | | x-ar | | = min| | x-ak||,  choose  C , (10) 

k r 

where  we  use  the  usual  notation  for  the  Euclidean  distance, 

1 1 x-ak  1 1 = [(x-ak)T  (x-a^)*!'2  . (11) 

For  the  cases  where  there  are  more  than  one  point  in  any  one  of 
the  classes,  the  N.N.  rule  classifies  the  unknown  tested  point  x 
as  a member  of  the  class  Cr  to  which  its  nearest  neighbor  belongs,  i.e., 

if  | | x- aT | | = min| | x-a^||  , choose  C . (12) 

J i,k  r 

The  average  probability  of  misclassif ication  of  an  N.N.  rule  P^‘N' 
is  bounded  by  the  Raves  error  in  the  following  way 


PB  < P 
e — 


N.N. 

e 


K 


where  K is  the  number  of  classes. 


(13) 


The  N.N.  rule  has  a practical  advantage  over  the  Bayes  rule  in 
that  the  difficulties  of  determining  the  regions  Rk  are  eliminated, 
and  of  course,  the  N.N.  rule  is  nonparametric  and  consequently  is  ap- 
plicable to  classification  problems  where  the  statistics  of  the  noise 
are  not  known. 
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III.  FEATURE  SELECTION 


The  features  at  our  disposal  are  the  scattering  matrix  parameters 
of  a set  of  given  frequencies.  A major  objective  of  a classification 
effort  is  to  minimize  the  dimensionality  of  the  feature  vector  for  a 
given  performance  level.  The  "cost"  of  the  various  parameters,  however, 
in  terms  of  system  complexity  and  difficulty  of  extraction  is  not  equal. 
The  most  costly  parameter  is  the  frequency,  since  each  additional  fre- 
quency may  require  an  additional  radar  operating  at  the  specified  fre- 
quency. It  is  for  this  reason  that  the  present  study  is  aimed  at  find- 
ing the  optimum  frequencies  given  that  either  a single  frequency  or 
at  most  two  frequencies  are  available.  The  other  parameters  that  are 
available  are  the  amplitude,  phase  and  polarization.  Here,  too,  the 
associated  costs  are  not  the  same.  Obviously,  amplitude  is  the  easiest 
parameter  to  obtain,  polarization  is  next,  and  the  most  difficult  one 
is  the  phase  parameter.  The  difficulty  is  in  eliminating  the  phase 
introduced  by  range  and  doppler.  One  way  of  eliminating  these  effects, 
discussed  in  Section  VIII,  is  by  reference  to  the  fundamental  frequency 
which  is  well  inside  the  Rayleigh  range  and  at  which  the  target  intro- 
duces a very  small  phase  shift.  The  use  of  the  fundamental  thus  implies 
the  use  of  a third  frequency  if  phase  is  extracted  by  the  above  method. 

As  to  polarization  we  are  assuming  that  two  orthogonal  polariza- 
tion components  are  available. 

Polarization 


ITS 

In  previous  studies  *'  * the  classification  performance  was  com- 
puted and  shown  for  each  of  two  orthogonal  polarizations.  The  two  com- 
ponents have  different  characteristics  in  that  the  component  parallel 
to  the  fuselage  in  the  Rayleigh  range  of  frequencies  is  much  stronger 
than  that  perpendicular  to  it,  but  it  has  been  found  that  the  perpen- 
dicular component  provides  the  best  discrimination  between  classes. 

Thus  the  first  (parallel  to  the  fuselage)  provides  good  SNR  in  the 
presence  of  noise  while  the  second  provides  good  classification  properties, 
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if  is  thus  advisable  to  use  both  components  in  an  actual  radar.  At 
frequencies  beyond  the  first  resonance  which  the  larqest  aircraft  en- 
counter the  above  statement  does  not  apply,  hut  since  the  orientation 
of  the  aircraft  with  respect  to  the  radar  is  a priori  unknown,  the  hori- 
zontal and  vertical  polarizations  as  described  above  cannot  be  preserved, 
thus  anv  polarization  will  on  the  average  contain  both  components  with 
a changing  mix.  It  was  therefore  decided  not  to  present  performance 
curves  for  each  polarization  but  rather  assume  that  the  radar  utilizes 
both. 

IV.  NOISE  MODEL 

The  noise  model  representing  the  noise  and  errors  of  a radar  system 
should  have  both  additive  and  multipl icative  components.  The  additive 
components  correspond  to  corruptive  influences  such  as  thermal  noise 
and  the  multiplicative  reflect  such  effects  as  measurement  errors  and 
clutter.  Because  of  the  mathematical  complexity  introduced  by  multi- 
plicative noise,  the  noise  model  chosen  here  is  additive  only  but  rep- 
resents the  multiplicative  components,  which  are  signal  level  dependent, 
f>v  normalizing  the  noise  variance  to  the  signal  power  level.  Thus  for 
=0.1  the  noise  standard  deviation  is  10%  of  the  average  signal  level. 
This  normal ization  of  the  noise  further  removes  such  parameters  as  range 
to  the  target,  antenna  gains,  transmitter  power,  etc.  from  affecting 
the  relative  strengths  of  noise  vs  signal.  The  statistical  nature 
of  the  noise  model  is  qaussian  due  to  the  assumption  that  several  rela- 
tively independent  sources  of  noise  and  error  contribute  to  the  total 
corruptive  influence;  invoking  the  central  limit  theorem  their  sum  tends 
to  a gaussian  distribution. 

It  should  be  borne  in  mind  that  the  precise  nature  of  the  noise 
is  less  important  than  its  effect  on  the  classification  performance. 

Thus  no  attempt  is  made  to  combat  the  noise  effect  by  devising  schemes 
taylored  to  its  statistics.  The  noise  serves  strictly  the  purpose  of 
determining  the  degradation  of  performance  with  increasing  noise  levels. 
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and  the  assessment  of  such  performance  as  the  selected  feature  sets 
are  varied. 

The  noise  components  are  added  to  the  signal  as  phasors  in  the 
following  way.  A noisy  amplitude  return  of  the  jth  component  of  a test 
vector  is 


JTs^r  a-  (n,)? 

where  S.  is  the  jth  frequency  component  of  the  signal  amplitude  signal 
and  n^,  n0  are  Gaussian  noise  components  with  zero  means.  When  the 
signals  considered  are  complex,  noise  is  added  algebraically  to  the 
two  orthogonal  components  of  the  signal.  Therefore,  the  jth  component 
of  a test  vector  becomes 


where  S-r  and  S-.  are  the  real  and  imaginary  components  of  the  jth  fre- 
quency return  at  the  selected  aspect  angle,  and  n,,  n4  are  Gaussian 
noises  whose  statistics  are  the  same  as  that  of  n, , n0.  The  standard 

deviations  of  n.  through  n.  are  normalized  to  S.//7,  which  is  off  by 
* ^ 1 9 4 ^ 

a factor  of  1/  2 from  all  the  previous  work  ’ ’ ’ but  serves  as  a better 
indicator  of  the  noise  level  in  terms  of  the  uncorrupted  signals. 

V.  EXPERIMENTS  BY  MONTE  CARLO  SIMULATION 

An  analytical  calculation  of  the  probability  of  misclassif ication 
for  the  N.N.  rule  is  rather  involved  because  it  requires  multidimensional 
integration  over  extremely  complicated  boundaries.  Therefore  Monte 
Carlo  simulation  was  employed  to  compute  performance.  In  the  following 
tests,  600  random  numbers  were  generated  in  each  case  and  added  to  the 
noise  free  signals  to  form  the  test  vectors.  The  newly  formed  vectors 
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were  then  classified  as  belonging  to  one  of  the  classes  according  to 
(13)  and  the  probability  of  misclassif ication  was  computed  by  counting 
the  number  of  mistakes  out  of  the  total  number  of  tests,  which  was  600 
for  each  case. 

The  coordinate  system  utilized  in  stating  the  observation  angles 
and  polarization  is  shown  in  Figure  1.  The  geometrical  center  of  the 
airplane  coincides  with  the  origin  of  the  coordinate  system.  Four  as- 
pect angles  are  chosen  in  the  experiments  and  their  scattering  returns, 
as  mentioned  before,  are  numerically  computed  to  provide  the  noise  free 
"learning"  set  of  vectors. 

Some  a priori  information  about  the  aspect  angle  (0,<t>)  of  an  air- 
craft is  usually  available  which  helps  in  the  identification  process. 

In  a practical  situation,  conventional  radar  Doppler  and  range  combined 
with  known  airplane  flight  dynamics  in  fact  provide  a fairly  close  es- 
timate of  (0,4>).  The  estimate  accuracy  was  assumed  to  be  within  ±5° 
in  <j>  and  0.  In  actuality  the  estimates  are  better  than  the  above  figure. 
Assuming  that  it  is  known  that  ( ‘T’q)  is  within  the  above  limits,  only 
an  angle  region  of  10°  in  0 and  <J>  centered  at  (0o,<j>  ) need  be  considered. 
Since  the  data  are  computed  only  at  discrete  values  of  aspect  angle, 
we  have  a set  of  angles  each  of  which  may  correspond  to  the  actual  as- 
pect angle  of  the  aircraft. 

Four  center  aspect  angles  corresponding  to  alternate  (P0,<t>0)  were 
chosen  as  representative  of  the  scattering  characteristics  of  the  air- 
craft. They  are, 

( 0°,o°l  nose  on. 


f P0° , Q0° 3 side  view. 


(45°, 45°). 


They  approximate  the  parametric  ranqe  of  scattering  values  for 
each  aircraft.  The  data  used  in  the  experiments,  therefore,  consists 
of  the  scattering  returns  of  9 different  aspects,  around  each  of  the 
above  angles. 


(0  1 (0  ,<*>  +5°),  (e  , 4>  -5°) 

' o’  0 O’  0 ’ O’  0 ' 


<V5o-V-  <V5°-V5°>-  <V5‘,-V5“> 


: ^ a c 0\ 


(O0+5°,4.o),  (0o+5°,4>o+5°),  (V5°’V50) 


In  two  of  the  above  cases,  namely  "nose  on"  and  "bottom  view"  the 
geometrical  symmetry  reduces  the  number  of  aspect  angle  from  9 to  6 
since  for  those  situations  (0o+5°)  and  (90-5°)  yield  the  same  electro- 
magnetic response. 

In  the  foil owi r i simulations,  all  aspect  angles  are  equally  weighted 
and  the  a priori  probabilities  are  considered  equal  for  all  the  aircraft 
in  evaluating  the  overall  probability  of  misclassif ication. 

To  simplify  the  notation  on  the  plots  the  following  abbreviations 
are  used. 


Class  Aircraft  type 


Dimensions 


F 104, 


16.69  m x 6.60  m x 4.11  m, 


C?:  Mig  19, 


13.49  m x 11.1?  m x ?.94  in. 


C3:  F 4, 


17.76  m x 11.7  x x 4.96  m. 


M 


lV 

Miq  21, 

15.76  m x 7.15  m x 4.50  m. 

<v 

Miq  25, 

?l,n  in  x !?.?  m x 5.0?  m, 

<v 

SR  71, 

.1?. 74  in  x 16.95  m x 5.64  m, 

C7: 

B 1. 

43.58  m x 23.77  m * 10.36  m. 

fR: 

F 14, 

24.36  m x 20.98  m x 7.67  in. 

The  symbol  f « 2n  MHz  is  used  to  represent,  the  frequency,  the  first 
harmonic  is  therefore  2 MHz. 

It  is  clear  from  the  above  discussions  that 

for  (0°,0°)  and  (90°, 0°) 

for  (90°, 90°)  and  (45°. 45°) 

V i,k  (15) 

The  noise  standard  deviation  is  normalized  with  respect  to  each 
individual  aircraft  return.  The  a priori  probabilities  here  are  all 
set  to  be  1/9  corresponding  to  the  eiqht  aircraft  stipulated. 

In  the  followlnq  sections  ( V I - 1 X ) the  cases  for  sinqle  frequency 
and  dual  frequency  returns  will  he  discussed  and  the  computed  classi- 
fication errors  presented. 
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VI.  SINGLF  FREQUENCY  AMPLITUDE  RETURNS 


The  simplest  case  considered  is  classification  using  a single  fre- 
quency amplitude  return,  utilizing  two  orthogonal  polarizations. 

Figures  2-6  show  the  results  for  the  best  S frequencies  out  of 
the  1?  frequency  data  available.  The  performance  is  shown  for  one  as- 
pect angle  but  it  is  representative  of  the  other  angles  as  well.  Since 
the  error  rates  are  unacceptably  high,  it  did  not  appear  to  be  useful 
to  provide  more  detailed  information  on  the  performance  of  this  feature 
set.  Each  curve  is  computed  by  Monte  Carlo  simulation  of  Equation  (1) 
and  the  average  curve  (see  Equation  (2))  is  plotted  to  show  the  overall 
performance  at  this  frequency.  Note  that  the  probabilities  of  misclassi- 
fication  for  some  aircraft  are  much  larger  than  those  for  other  aircraft, 
indicating  a bias  effect  among  the  targets  to  be  classified.  This  ef- 
fect is  very  large  for  some  aircraft  (e.g.,  Pp(Cj)  and  Pp(Cq)  in  Figure 
21  and  degrades  the  overall  performance  quite  significantly.  The  phe- 
nomenon is  mainly  due  to  the  inhomogeneous  distribution  of  data.  For 
instance,  the  identification  of  an  aircraft  with  the  data  surrounded 
hy  those  of  others  would  be  subject  to  more  mistakes  than  one  whose 
data  are  only  partially  in  proximity  with  others.  Indeed  in  a two  class 
case,  for  example,  where  the  data  of  one  class  surround  that  of  the 
other,  the  probability  of  choosing  the  surrounding  class  will  keep  in- 
creasing as  the  noise  increases,  producing  a pronounced  bias  to  the 
extent  that  for  any  large  noise  variances  the  probability  of  selecting 
the  surrounding  class  will  tend  to  unity  and  the  misclassif ication  prob- 
abilities for  the  two  classes  will  tend  to  zero  and  unity  respectively. 
The  bias  effect  may  also  produce  apparently  anomalous  effects  such  as, 
for  example,  curve  Pe(Cp)  in  Figure  5,  where  the  error  probability  starts 
decreasing  beyond  a certain  value  of  noise  variance.  To  explain  this 
apparently  anomalous  behaviour  we  assume  a particular  distribution  for 
a 2 class  classification.  Each  class  has  2 points  in  one  dimensional 
space  as  shown  in  Fiqure  7.  Suppose  the  2 points  coincide  and  2 
points  are  not  clustered  together;  instead,  they  are  spread  around 
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Figure  ?.  Probability  of  misclassif ication  for  individual  aircraft, 
using  amplitude  returns  at  frequency  fj  and  (0,0°) 
aspect  angle  (nose  on). 
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F igure  3 
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Probability  of  misclassif ication  for  individual  aircraft, 
using  amplitude  returns  at  frequency  fp  and  (0,0°) 
aspect  angle  (nose  on). 
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Figure  4.  Probability  of  misclassif ication  for  individual  aircraft, 
using  amplitude  returns  at  freguency  f^  and  (O' ,0 ) 
aspect  angle  (nose  on). 
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Figure  6.  Probability  of  misclassif ication  for  individual  aircraft, 
using  amplitude  returns  at  frequency  f and  (0°,0°! 
aspect  angle  (nose  onl . 1 
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Figure  7.  A two  class  distribution  leading  to  an  anomalous 
classification  behavior, 
o denotes  class 
x denotes  class  C, 

the  C.,  points  as  shown  in  the  figure.  The  noise  added  to  each  class 
is  assumed  to  he  Gaussian  with  zero  mean.  It  is  obvious  that  an  N.N. 
rule  will  lead  to  a fixed  boundary  for  each  region  and  the  probability 
of  misclassif ication  of  C?  is  just  one  half  of  the  sum  of  the  two  shaded 
areas.  It  can  be  shown  that 


W = erfc(|^)  - erfc(|^)  , 


where  the  complementary  error  function  is  defined  as 


erfc(x)  ^ /°°  7— r e ? dy 
x J 2 ji 


The  function  ) is  plotted  in  Figure  8.  Pe(C,,)  increases  as  a/o 
goes  up  from  0 to  1.05,  and  decreases  as  a/o  increases.  When  a is  fixed, 
P IC-!  increases  as  o H.e.,  the  standard  deviation  of  Gaussian  noise! 
goes  up  till  o = a/1.05;  the  shaded  areas  begin  to  decrease  as  o goes 
over  this  point  and  tend  to  zero  as  the  noise  level  goes  to  infinity. 

This  shows  that  the  probability  of  misclassif ication  Pe(C?!  does  not 
necessarily  Increase  as  the  noise  level  goes  up,  as  was  seen  for  P (C„! 
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in  Figure  5.  This  anomalous  behavior  is  reduced  as  the  dimensionality 
of  the  feature  vector  increases  since  the  likelihood  of  class  enclosure 
by  its  neighbor  decreases. 


Pe  (C2) 


Figure  8.  Average  probability  of  misclassif ication  of 
Class  C?  in  Figure  7. 

An  important  characteristic  of  the  classification  features  is  the 
size  of  aircraft.  Since  the  electromagnetic  amplitude  response  is  ap- 
proximately proportional  to  the  size  of  an  illuminated  scatterer  at 
frequencies  below  resonance,  the  targets  whose  sizes  vary  significantly 
from  the  average  would  be  fairly  easy  to  separate  from  the  main  group 
of  targets  and  hence  bea-  smaller  probabilities  of  error  in  classifi- 
cation. This  is  shown  by  the  performance  of  and  C7  in  Figures  ?. 
and  7.  Note  that  C?  (Bl)  is  the  largest  aircraft  among  all  the  investi- 
gated ones  and  is  di st ingui shed  from  all  others  pretty  easily  in  almost 
all  cases  since  its  amplitude  returns  are  much  larger  than  those  of 
others  over  most  of  the  operating  frequency  range.  This  advantage 
is  not  present  for  airplanes  of  approximately  equal  size.  The  discrim- 
ination between  some  airplanes  are  difficult  at  certain  frequencies 
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because  their  scattering  returns  are  very  similar.  This  similarity 
occurs  for  different  airplanes  at  different  frequencies. 

The  classif ication  performance  shown  in  Figures  2-6  is  for  the 
aspect  angle  (0°,0°).  The  performance  at  the  other  three  observation 
angles  is  represented  in  in  Figures  9-11.  The  optimum  frequency  is 
the  same  for  all  angles,  namely  4 MHz.  The  change  in  the  observation 
and  illumination  angle  does  not  affect  significantly  the  performance. 

This  is  due  to  relative  shape  independence  of  the  amplitude  response 
when  operating  well  within  the  Rayleigh  range  of  frequencies.  Figures 
1'M6  depict  the  average  performance  for  the  eight  aircraft  at  each 
of  the  observation  angles  for  the  best  frequencies.  It  is  evident  that 
f.,  - 4 MHz  is  the  optimum  frequency  for  all  observation  angles.  The 
reason  for  the  optimality  of  such  a low  frequency  is  that  utilizing 
single  frequency  amplitude  returns  the  discrimination  feature  is  the 
scattering  cross  section  which  is  directlv  related  to  size  (in  the  Rayleigh 
range!.  The  main  advantages  of  higher  frequencies  is  phase  information 
which  is  ignored  when  amplitude  alone  is  used  as  a discriminant. 

The  relative  average  performance  at  the  optimum  frequency  is  shown 
in  Figure  16. 

VII.  SINGLE  FREQUENCY  COMPLEX  RETURNS 

4 significant  improvement  over  the  previous  results  was  achieved 
by  using  phase  information  in  addition  to  amplitude  information.  With 
the  introduction  of  phase,  the  dimensionality  of  each  tested  vector 
increases  from  two  to  four.  Also  the  performance  at  higher  frequencies 
becomes  superior  to  lower  frequency  performance  because  the  phase  vari- 
ations become  more  pronounced  at  the  higher  frequencies,  reflecting 
shape  changes.  The  size  changes  are  detected  by  amplitude  variation 
and  the  comhined  effect  produces  a substantially  improved  performance 
compared  to  previous  results.  The  irregularities  that  appeared  in  the 
last  section  are  reduced  drastically  due  to  the  higher  dimensionality. 
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l igure  o.  Prohah  1 1 i t„y  of  misclass if icat ion  for  iruli v idu.il  ^aircraf  t , 
using  amplitude  returns  at  frequency  f,  and  (90o,01’ 
aspect  angle  (bottom  view'. 
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Figure  in.  Probability  of  misclassification  for  individua^airgraft. 

usinq  amplitude  returns  at  frequency  f„  and  (90  ,90°) 
aspect  angle  (side  view!. 
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Figure  11.  Probability  of  misclassif ication  for  individual  air-raft, 
using  amplitude  returns  at  frequency  f„  and  (45°, 45°) 
aspect  angle.  ^ 
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Figure 


12.  The  average  performance  at  different  frequencies,  using 

single  frequency  amplitude  returns.  The  observation  angle 
is  9=0°,  <f>=(l°. 


Figure  13.  The  average  performance  at  different  frequencies,  using  single 
frequency  amplitude  returns.  The  observation  angle  is  6=90e, 
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Tiquro  14.  The  average  performance  at  different  frequencies,  usinq 

single  frequency  amplitude  returns.  The  observation  anqlt 
is  fl  90°.  ; 90° . 


Figure  15.  The  average  performance  at  different  frequencies,  using 

single  frequency  amplitude  returns.  The  observation  angle 
is  0-45° . *=45°. 
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Figures  1 7-26  show  the  results  for  the  best  frequencies  at  four  aspect 
angles.  The  probabilities  of  misclassif ication  can  be  seen  to  be  sub- 
tantially  lower  than  for  the  amplitude  features  alone.  The  errors  are 
negligibly  small  up  to  noise  levels  of  of  signal  level  and  even 
for  ?0*  noise  level  the  worst  error  probability  is  0.15  at  (90°, 00°) 
(side  view!  for  targets  and  C^,  with  other  observation  angles  pro- 
ducing substantially  lower  errors.  In  fact  when  the  error  is  averaged 
over  all  classes  for  each  observation  anqle,  the  optimum  frequencies 
produce  less  than  .05  probability  of  mi scl assif ication  for  the  (90°, 90°) 
observation  angle,  .0 P for  (90°, 0°)  and  undetectable  errors  for  (0°,0°1 
and  (45°, 45°!,  for  a ?0*  noise  level  injection  (see  Figures  ?7-30!. 

The  bias  phenomena  described  above  still  exist  but  are  substan- 
tially reduced,  due  to  a higher  dimensionality  of  the  feature  vectors. 
Some  frequencies,  however  yield  significantly  better  performance  than 
others  because  the  scattering  responses  of  different  airplanes  at  these 
frequencies  are  more  dissimilar,  improving  the  overall  performance  (Fig- 
ures ?7-30).  This  is  especially  true  at  the  two  aspects,  (0°,0°)  and 
(45°, 45°),  where  the  similarity  of  the  data  is  pretty  weak. 

The  data  similarity  are  exemplified  by  the  bottom  view  (90°, 0°). 

The  two  (vertically  and  horizontally)  polarized  waves  are  exciting  the 
fuselages  and  the  wings  of  the  aircraft.  Their  dimensions,  however, 
are  very  close  for  some  aircraft  (e.g.,  for  fuselages:  (F  104)  - 

16.69  m,  ( M i g ?1)  - 16.75  m,  (F  4)  - 17.76  m;  for  wings:  -6.66 

m,  - 7.6  m,  etc.)  At  the  low  frequencies,  where  overall  dimensions 
dominate,  the  scattering  returns  of  these  aircraft  are  so  close  (see 
Figures  31-3?)  that  to  distinguish  them  becomes  rather  difficult  (see 
Pp(C^)  and  P^fC^)  in  Figures  19  and  ?0! . This  kind  of  data  similarity 
is  reduced  as  the  frequency  increases  (Pp  (C^)  and  ) in  Figures 

°1  and  ??),  where  the  scattering  returns  are  more  shape  responsive. 

At  f^9,  we  obtain  the  best  performance  at  this  aspect  (Figure  ??). 
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I inure  17.  Probability  of  misclassification  for  individual  aircraft, 
usinq  complex  returns  at  frequency  f . and  (0°,0°) 

aspect  anqle  (nose  on). I  11 
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Figure  13.  Probability  of  misclassif ication  for  individual  aircraft, 
using  complex  returns  at  frequency  f.,,  and  (0  ,0°1 
aspect  angle  (nose  onL 
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Figure  IQ.  Probability  of  mi  sc  1 ass  i f 1o.it  ion  for  individual  ^ 
using  complex  returns  at  freguenc.v  f.,  and  (Q(l  ,0 
aspect  angle  (bottom  viewl. 
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Figure  21.  Probability  of  misclassification  for  individual  aircraft, 
using  complex  returns  at  frequency  f,  and  (90  ,0°) 
aspect  angle  (bottom  viewl.  b 
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Probability  of  misclassif ication  for  individual^  aircraft 
using  complex  returns  at  frequency  f^  and  (°0  ,Crl 
aspect  angle  (bottom  viewl. 
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Figure  ??.  Probability  of  misclassif ication  for  individual  aircraft, 
using  complex  returns  at  frequency  f ^ and  (90°, 90°) 
aspect  angle  (side  view). 
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Figure  24. 


Probability  of  misclassification  for  individual  aircraft 
using  complex  returns  at  frequency  f,  and  (45°, 45°) 
aspect  angle.  b 
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Figure  ?fi.  Probability  of  misclassif ication  for  individual  aircraft, 
usinq  complex  returns  at  frequency  f^  and  (45  ,45°) 
aspect  angle. 
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I inure  27  The  average  performance  at  different  frequencies,  us i nq 
sinqle  frequency  complex  returns.  The  observation  annle 
is  0‘’=O1' , 4-=U1’. 
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PROBABILITY  OF  M I SCLA  SS  I FCAT  ION 


Figure  30.  The  average  performance  at  different  frequencies, 
using  single  frequency  complex  returns.  The 
observation  angle  is  0=45°,<t)=45o. 
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Comparing  the  complex  responses  of  the  targets  (Figures  33-36) 
to  the  amplitude  responses,  we  see  that  employing  the  phase  information 
not  only  increases  the  dimensional ity  of  the  features,  hut  also  extends 
the  range  of  each  feature  from  positive  values  alone  to  the  whole  real 
axis.  Note  that  the  imaginary  parts  of  the  complex  scattering  returns 
of  all  the  aircraft  at  the  bottom  view  are  all  positive,  indicating 
that  the  phases  are  always  less  than  ^0  degrees.  This  is  due  to  the 
fact  that  the  height  (thickness)  of  the  aircraft  is  less  than  1/4  wave- 
length within  the  operating  frequency  range  (?  MHz  - ?4  MHz).  The  re- 
sultant phase  differences  from  the  portions  of  the  aircraft  do  not  vary 
more  than  90  degrees  at  this  specific  aspect  angle.  This  limited  vari- 
ation in  phase  does  not  hold  for  other  aspects  like  (0°,0°)  (see  Figures 
17-4?)  and  (46°, 46°),  leading  to  a better  performance  at  these  aspects 
when  utilizing  the  phase  information.  Hence,  the  performance  of  the 
classifier  is  rather  orientation  dependent  (Figure  43). 

In  general  as  the  frequency  increases  from  the  first  harmonic  up, 
the  performance  improves  both  due  to  the  increased  scattering  amplitude 
in  the  Rayleigh  range  and  the  increased  phase  variations  which  are  shape 
sensitive.  As  the  first  resonance  is  crossed  the  scattering  amplitude 
oscillates  with  frequency  (Figures  31,  3?,  41,  4?),  since  most  targets, 
however,  resonate  at  different  frequencies  these  oscillations  contribute 
to  further  data  separation  among  the  targets  and  thus  improve  overall 
performance. 
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inure  37.  Peal  part  of  horizo 


Figure  42. 


Amplitude  returns  of  vertically  polarized  electromagnetic 
scattering  response  for  eight  aircraft  at  9=0°,  <t=0°. 
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1 i'lure  43.  Performance  conparison  for  different  aspect  anqles 
employ inn  optimum  sinqle  frequency  complex  returns 


VIII. 


SINGLE  FREQUENCY  COMPLEX  RETURNS  COMBINED  WITH  THE 
AMPLITUDE  OF  THE  FUNDAMENTAL  HARMONIC 


In  order  to  obtain  target  phase  information  it  is  necessary  to 
remove  the  phase  produced  by  range  and  the  doppler  frequency.  A rela- 
tively simple  method  of  achieving  this  is  by  utilizing  the  fundamental, 
or  first  harmonic.  Since  the  target  phase  at  this  low  frequency  is 
approximately  zero  it  may  be  assumed  that  the  phase  associated  with 
the  target  is  strictly  due  to  range.  Also  it  can  serve  as  a reference 
for  the  removal  of  the  doppler. 

Let  the  return  of  the  fundamental  be  given  by 

R„  = A.  cos  I lJ„t  + w.jt  + + <{> 

oo  l o od  X o 
V o 


where  io  is  the  frequency  of  the  fundamental,  X its  wavelenqth,  A 
the  amplitude  of  the  scattered  return,  its  phase  and  the  range  delay 
'1nr/\(i  adding  to  the  phase  at  the  receiver.  The  frequency  is  the 
Doppler  shift  produced  by  the  target's  motion.  Since  the  phase  may 
he  assumed  to  he  negligibly  small  the  phase  of  a higher  harmonic,  at 
say  nw^,  may  be  obtained  by  frequency  multiplying  the  return  of  the 
fundamental  by  n and  comparing  the  phases  of  the  two  signals.  Forming 
the  phase  difference  we  obtain 


A<}>  = 


nut  t 

o 


"“’od1 


Pirr 

TVnT 


nut  t - nw  .t 
o od 


2ntir  . .... 

Xp  To  n To  ^n 

Thus  the  range  effect  on  phase  as  well  as  the  Doppler  are  removed,  yield- 
ing the  phase  of  the  scattered  object  at  the  nth  harmonic.  If  this 
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approach  is  indeed  utilized,  one  must  assume  the  availability  of  the 
first  harmonic  and  it  is  apparent  that  it  would  be  advantageous  to  utilize 
this  additional  feature  in  the  classification  process.  Including  the 
added  feature  yields  the  performance  shown  in  Figures  44-55  which  in- 
dicate somewhat  lower  error  rates  than  shown  in  Figures  18-30  that  did 
not  use  the  lowest  harmonic.  The  improvement  varies  with  observation 
angles  and  frequencies,  in  some  cases  reducing  error  probabilities  by 
a factor  of  two  and  in  others  just  slightly. 

A set  of  curves  in  Figures  56-59  summarizes  the  improvements  af- 
forded by  the  successive  addition  of  the  features  discussed  above.  The 
curves  show  the  error  probabilities  resulting  from  the  use  of  each  of 
the  twelve  frequencies  fj  through  f^.  The  comparison  is  made  between 
the  use  of  Al  amplitude  alone,  B)  amplitude  and  phase,  and  C)  amplitude 
and  phase  of  each  frequency  f9  through  f^9  in  conjunction  with  the  first 
harmonic  amplitude. 

Comparing  the  complex  (amplitude  and  phase)  to  amplitude  alone, 
a very  large  drop  in  error  probabilities  is  evident  at  all  but  the  lowest 
harmonics  where  the  phase  contribution  is  rather  small.  Note  that  the 
improvement  is  smallest  in  the  9-90°,  <t>=0°  case  which  is  the  bottom 
view.  The  reason  for  this  is  the  relatively  small  phase  contribution 
until  frequencies  reach  fairly  high  levels.  As  mentioned  above  the 
physical  distance  between  the  phase  center  and  the  geometrical  center 
from  this  observation  angle  is  very  small  and  consequently  the  target 
phase  is  quite  small  and  increases  slowly  with  rising  frequencies. 

It  is  in  this  case  where  the  fundamental  harmonic  provides  a substantial 
improvement.  The  same  can  be  seen  at  all  angles  for  low  frequencies 
where  phase  is  of  little  help.  Curve  C reflects  substantial ly  reduced 
error  probabilities.  As  the  frequency  increases  the  fundamental  pro- 
vides some  improvement  hut  it  is  not  very  significant. 
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Figure  45.  Probability  of  misclassif ication  for  individual  aircraft, 
usinq  complex  returns  at  frequency  f,?  with  the  fundamental 
harmonic  at  f0o,Cr!  aspect  angle  (nose  on!. 
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Figure  47.  Probability  of  miscl assif ication  for  individual  aircraft, 

using  complex  returns  at  frequency  f.?  with  the  fundamental 
harmonic  at  (90°, 90°)  aspect  angle  (side  view). 
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Figure  4.9.  Probability  of  misclassif ication  for  individual  aircraft, 
using  complex  returns  at  frequency  f^  with  the  fundamental 
harmonic  at  (45  ,45°)  aspect  angle. 
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Finure  49  Probability  of  misclassif ication  for  individual  aircraft 
q ' using  complex  returns  at  frequency  fg  with  the  fundamenta 

harmonic  at  (45  ,45  ) aspect  angle. 
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Figure  50.  Probability  of  misclassification  for  individual  aircraft, 

using  complex  returns  at  frequency  f^  with  the  fundamental 
harmonic  at  (45°, 45°)  aspect  angle. 
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Figure  51.  The  average  performance  at  different  frequencies,  using 
single  frequency  complex  returns  and  the  fundamental 
harmonic.  The  observation  angle  is  0=0°,  $=0°. 
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figure  53.  The  average  performance  at  different  frequencies,  using 
single  frequency  complex  returns  and  the  fundamental 
harmonic.  The  observation  angle  is  0=90°,  $=90°. 
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Figure  1>4 . The  average  performance  at  different  freouencies,  using 
single  frequency  complex  returns  and  the  fundamental 
harmonic.  The  observation  angle  is  0=45°,  <j)=45°. 
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Figure  55.  Performance  comparison  for  different  aspect  angles 

employing  optimum  single  frequency  and  the  fundamental 
harmonic  returns. 
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8 12  16  20  24 

FREQUENCY  (MHz ) 


Figure  b6.  Comparison  of  average  probability  of  misclassification, 

using  3 different  sets  of  features  for  the  eight  aircraft 
at  0-0",  4>=0".  The  noise  added  to  each  signal  is  20%  of 
the  noise  free  signal. 

A=  single  frequency  amplitude  returns 

P>=  single  frequency  complex  returns. 

C=  single  frequency  complex  returns  with  the 
fundamental  harmonic. 
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PROBABILITY  OF  M I SC  LASS  I F I CAT  ION 


frequency  complex  returns  with  the  fundamental  harmonic 


FREQUENCY  ( MHz ) 


Fiqure  59.  Comparison  of  probability  of  misclassif ica- 
tion,  usinq  3 different  sets  of  features  for 
the  eight  aircraft  at  9=45°,  ^=45° . The  noise 
added  to  each  signal  is  20'..  of  the  noise  free 
siqna  1 . 

A=sinqle  frequency  amplitude  returns. 

B=single  frequency  complex  returns. 

('  single  frequency  complex  returns  with  the 
f undamen ta 1 harmon i c . 


The  use  of  the  first  harmonic  as  a reference  is  advantageous  if 
the  higher  harmonic  whose  complex  return  is  utilized  is  not  a high  multiple 
of  the  fundamental.  For  under  these  circumstances  the  phase  n<t>  is 
indeed  small.  If,  however  n is  large  then  n^  is  not  negligible  and 
introduces  a phase  offset  which  prevents  the  accurate  determination 
of  4>n  the  target  phase  at  the  nth  harmonic.  For  classification  purposes, 
however,  the  absolute  target  phase  is  not  required,  the  relative  phase 
(■t'n-n4>0)  can  serve  as  a modified  phase  feature  which  will  yield  in  turn 
a modified  complex  return.  If  the  phase  at  the  lowest  harmonic  is  not 
negligible  there  may  be  an  advantage  in  using  a higher  harmonic  than 
the  fundamental  for  phase  reference.  The  main  advantage  in  using  a 
hiqher  frequency  would  be  the  resulting  improvement  in  angular  resolu- 
tion, but  additionally  if  n is  large  any  error  in  measuring  <j>  would 

0 

get  magnified  by  a large  factor  n.  Thus  picking  an  adjacent  frequency 

say  (n-Huio  would  eliminate  this  effect  and  would  provide  a much  more 

convenient  implementation  as  a radar  system.  It  would  therefore  be 

of  interest  to  evaluate  the  classification  performance  utilizing  various 

frequency  pairs  with  one  of  them  as  a reference.  Note  that  the  measured 

net  phase  of  the  kth  target  illuminated  by  the  nth  harmonic  with  the 

k k k 

mth  harmonic  as  reference  would  be  (<j>n  - n/m  4>m) , where  <(>  is  the  target's 
phase  at  frequency  nw  . 

IX.  CLASSIFICATION  PERFORMANCE  UTILIZING  TWO  FREQUENCIES 

In  previous  discussions  we  have  limited  the  number  of  frequencies 
used  to  one_, except  for  the  auxiliary  amplitude  of  the  fundamental. 

At  present  we  introduce  the  simultaneous  use  of  two  frequencies  picked 
from  the  set  f^=?  MHz  through  f^,,=?4  MHz.  We  will  again  consider  first 
the  use  of  amplitude  alone,  followed  by  the  utilization  of  both  phase 
and  amplitude,  that  is  two  orthoqonal  components  for  each  frequency, 
and  in  each  case  two  orthogonal  polarizations  are  employed.  We  have, 
therefore,  a four  feature  vector  for  the  amplitude  case  and  an  eiqht 
feature  vector  for  the  complex,  or  amplitude  and  phase,  case. 


76 


The  effort  involved  in  choosing  the  optimum  two  frequencies  is 

substantially  greater  than  twice  the  effort  of  choosing  one  frequency 

because  the  two  jointly  optimum  frequencies  are  not  the  best  and  second 

best  single  frequencies.  This  is  true  even  in  the  case  when  all  features 

are  mutually  independent  and  even  more  so  when  they  are  correlated  as 

7 n 

in  the  present  case.  ’ We  were  thus  faced  with  a study  involving  all 
possible  combinations  of  frequency  pairs.  Since  no  analytical  method 

O 

for  optimum  choices  is  available  one  must  resort  to  an  exhaustive  search.1 
The  classification  results  utilizing  two  frequency  amplitude  returns 
are  shown  in  Figures  60-69.  Figures  60-64  show  the  performance  for 
each  aircraft  at  the  optimum  frequency  and  the  four  chosen  aspects. 

The  performance  is  considerably  better  than  in  using  only  a single  fre- 
quency amplitude  return  but  worse  than  in  using  a single  frequency 
complex  return  although  the  same  number  of  features  are  used.  The  better 
performance  of  the  single  frequency  may  be  due  to  the  fact  that  in  using 
two  frequency  amplitude  returns,  the  returns  are  always  positive,  while 
in  using  one  frequency  complex  returns,  each  component  can  be  either 
positive  or  negative,  increasing  the  range  of  the  variable  in  feature 
space  and  consequently  providing  a better  performance.  This  indicates 
that  the  phase  information  may  be  more  effective  than  amplitude  infor- 
mation in  considering  the  use  of  additional  features.  Figure  63  shows 
that  the  amplitude  features  yield  a peculiar  response  for  some  indi- 
vidual aircraft  (C^  here)  as  mentioned  before,  whereas  in  using  one 
frequency  complex  returns  this  kind  of  odd  response  is  essentially  elim- 
inated. Figures  65-69  show  the  average  performance  of  the  best  five 
frequencies  at  the  four  chosen  angles.  As  may  be  expected  of  amplitude 
returns,  they  are  fairly  orientation  invariant. 

The  probability  of  misclassif ication  for  each  individual  aircraft 
using  two  frequency  complex  returns  are  shown  in  Figures  70-89.  The 
performance  curves  for  each  aircraft  for  the  best  five  frequencies  at 
nach  of  the  four  aspect  angles  are  all  listed  here  because  they  all 
did  fairly  well  in  terms  of  the  overall  average  probability  of  error. 
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Fioure  €2.  Probability  of  misclassification  for  individual  aircraft, 
using  amplitude  returns  of  f„,  f , , at  (90°, 90°)  aspect 
angle  (side  view). 
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Figure  66.  The  average  performance  at  different  frequencies,  using 
two  frequency  amplitude  returns.  The  observation  angle 
is  0=90°  , 4>=0° . 
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Figure  68.  The  average  perfornance  at  different  frequencies,  using 
two  frequency  amplitude  returns.  The  observation  angle 
is  0=45°,  <t>=45° . 
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0.30 


Figure  69.  Performance  comparison  for  different  aspect  angles 
employing  optimum  two  frequency  amplitude  returns. 
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Figure  74.  Probability  of  misclassification  for  individual  aircraft, 
using  complex  returns  of  f,,,  f,?  at  (0C,0°)  aspect  anqle 
(nose  on). 
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Figure  76.  Probability  of  misclassification  for  individual  aircraft, 
using  complex  returns  of  fg,  f^  at  (90°,  0°)  aspect  angle 
f bottom  view'. 
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NOISE  STANDARD  DEVIATION 


Figure  77.  Probability  of  misclassif ication  for  individual  aircraft, 
using  complex  returns  of  f p , fp  at  (90°, 0")  aspect  anole 
(bottom  view). 
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Figure  79.  Probability  of  misclassification  for  individual  aircraft, 
using  complex  returns  of  f7,  f.„  at  (90°, 0°)  aspect  angle 
(bottom  view) . 


Figure  80.  Probability  of  misclassif ication  for  individual 
aircraft  using  complex  returns  of  fc,  fn  at 
(90°, 00°)  aspect  angle  (side  view). 
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Figure  85.  Probability  of  miscl assification  for  individual  aircraft, 
using  complex  returns  of  fg,  fg  at  (45°, 45°)  aspect  angle. 
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Figure  86.  Probability  of  misclassification  for  individual  aircraft, 
using  complex  returns  of  f^,  f^  at  (45°,  45°)  aspect  angle. 
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Figure  87.  Probability  of  miscl assification  for  individual  aircraft, 
using  complex  returns  of  fp,  f,0  at  (45°,4b°)  aspect 
angle. 
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Figure  89.  Probability  of  mi  sclassif ication  for  individual  aircraft, 
usinq  complex  returns  of  ffi,  f.„  at  (45", 45")  asnect. 
angle.  1 
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The  performance  curves  for  (90°, ^0°)  are  worse  than  others,  but  note 
that  we  have  doubled  the  error  scale  since  error  rates  are  very  low. 

The  probabilities  of  individual  mi  sc  1 ass i f ication  of  and  are  rela- 
tively hiqh  because  the  scattering  returns  for  those  two  airplanes  are 
close  to  each  other  over  the  observed  frequency  ranqe,  degrading  the 
overall  performance.  This  occurs  only  when  both  sizes  and  shapes  of 
aircraft  appear  to  be  very  similar  at  the  chosen  observation  angles, 
and  does  not  happen  too  often.  Again  the  orientation  dependence  is 
quite  strong  for  the  same  reasons  as  discussed  before  (Figure  94). 

The  average  probability  of  mi  sc  lass  if ication  has  been  reduced  to  less 
than  15%  in  all  aspect  angles  when  the  level  of  noise  standard  deviation 
is  50  percent  (Figures  90-94). 

A perforinancesummary  for  different  sets  of  features  is  shown  in 
Figures  95-98.  The  classification  reliability  increases  as  the  fol- 
lowing feature  sets  are  selected  in  the  order  shown:  (1)  single  fre- 
quency amplitude  returns,  (?)  two  frequency  amplitude  returns,  (3)  single 
frequency  complex  returns,  (4)  single  frequency  complex  returns  with 
the  fundamental  harmonic,  (5)  two  frequency  complex  returns.  In  uti- 
lizing two  features,  the  phase  information  shows  stronger  effect  than 
an  amplitude  at  an  additional  frequency.  This  is  caused  by  the  close- 
ness amonq  two  frequency  amplitude  returns  since  the  system  is  operating 
at  frequencies  mostly  within  the  Rayleigh  range.  On  the  other  hand 
components  of  complex  returns  can  go  either  positive  or  negative,  in- 
creasing their  variability  and  reducing  the  closeness  among  the  data. 

The  results  obtained  indicate  that  the  optimum  frequency  pairs 
at  different  observation  angles  are  different.  For  a practical  system, 
it  may  he  inconvenient  to  change  the  operating  frequencies  as  the  ori- 
entation of  the  observed  target  varies.  In  this  case  a pair  of  fre- 
quencies must  be  chosen  beforehand  in  designing  a radar  system. 
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Fiqurp  90.  The  average  performance  at  different  freouencies,  usino 
two  freouency  complex  returns.  The  observation  angle 

is  0=0",  4>=0". 
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Figure  93.  The  average  performance  at  different  frequencies,  usinn 
two  frequency  complex  returns.  The  observation  angle 
is  0=45°,  4>=45° . 
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PROBABILITY  OF  MISCLASSIF  I CAT  ION 


I SINGLE  FREQUENCY  AMPLITUDE  RETURNS 
2.  SINGLE  FREQUENCY  COMPLEX  RETURNS 

3 SINGLE  FREQUENCY  COMPLEX  RETURNS 
WITH  THE  FUNDAMENTAL  HARMONIC 
4.  TWO  FREQUENCIES  AMPLITUDE  RETURNS 


Figure  o.S.  Performance  comparison  for  different  combinations  of 
features  at  P=0D,  4'=0°  employing  optimum  set  of 
frequency  returns. 


1.  single  frequency  amplitude  returns 

2.  SINGLE  FREQUENCY  COMPLEX  RETURNS 

3.  SINGLE  FREQUENCY  COMPLEX  RETURNS 
WITH  THE  FUNDAMENTAL  HARMONIC 


Figure  96  Performance  comparison  for  different  combinations  of 
features  at  9=90",  ^>=0"  employing  optimum  set  of 
frequency  returns. 
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1.  SINGLE  FREQUENCY  AMPLITUDE  RETURNS 

2.  SINGLE  FREQUENCY  COMPLEX  RETURNS 

3.  SINGLE  FREQUENCY  COMPLEX  RETURNS 
WITH  THE  FUNDAMENTAL  HARMONIC 

4.  TWO  FREQUENCIES  AMPLITUDE  RETURNS 


Figure  97.  Performance  comparison  for  different  combinations  of 
features  at  0=90°, *=90°  employing  an  optimum  set 
of  frequency  returns. 
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1.  SINGLE  FREQUENCY  AMPLITUDE  RETURNS 

2.  SINGLE  FREQUENCY  COMPLEX  RETURNS 

3.  SINGLE  FREQUENCY  COMPLEX  RETURNS 
WITH  THE  FUNDAMENTAL  HARMONIC 

4.  TWO  FREQUENCIES  AMPLITUDE  RETURNS 


Figure  98  Performance  comparison  for  different  combinations  of 
features  at  0=45°,  ^=45°  employing  an  optimum  set  of 
frequency  returns. 
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One  would  be  led  to  chose  the  frequency  pair  such  that  the  error 
averaged  over  all  aspect  angles  is  smallest.  However,  this  may  not 
be  satisfactory  since  the  error  at  a specific  aspect  might  not  be  tol- 
erable while  the  system  performs  extraordinari ly  well  at  other  aspects. 
Therefore,  it  it  more  reasonable  to  choose  a frequency  pair  such  that 
the  worst  performance  at  all  aspects  considered  is  the  smallest.  Fran 
the  data  available,  this  optimum  frequency  pair  is  fjj  and  fj9  (Figure 
99).  The  performance  when  using  these  two  frequencies  at  the  four  aspect 
anqles  are  plotted  in  Figure  99  and  the  unlabelled  curve  represents 
the  average.  It  is  shown  that  at  this  optimum  frequency  pair,  the  scheme 
performs  very  satisfactorily  even  when  the  noise  level  is  extremely 
high  (o=0.5).  This  also  shows  that  N.N.  rule  can  distinguish  the  eight 
aircraft  in  all  the  considered  aspects  with  the  low  probability  of  mis- 
classif ication  when  the  system  is  operating  at  the  optimum  frequencies. 


Figure  99.  The  average  performance  at  4 different  aspect 
angles  with  the  use  of  the  optimum  frequency 
pair  (fji  and  f ^ ^ and  complex  returns. 
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X.  CONCLUSIONS 


1 


The  study  of  optimum  frequencies  for  aircraft  classification  has  shown 
that  a high  reliability  of  correct  classification  can  be  obtained  when  as 
few  as  two  frequencies  are  used.  This  holds  true  for  noise  environments 
up  to  30%  of  signal  levels.  A set  of  curves  is  provided  showing  the  rela- 
tive performances  of  single  and  two  frequency  returns  and  the  effect  of 
phase  information  on  the  performance.  These  results  indicate  that  phase 
information  is  very  effective  in  reducing  misclassif ication  probabilities. 
Indeed  single  frequency  returns  provide  adequate  performance  of  over  95% 
reliability  in  the  presence  of  noise  of  up  to  20%  of  signal  level. 

The  eiqht  aircraft  that  were  chosen  for  classification  represent  a 
rather  difficult  set  since  some  of  them  are  very  similar  in  size  while  others 
are  substantially  different.  This  puts  a severe  constraint  on  the  choice 
of  frequencies  since  the  set  of  small  similar  objects  require  frequencies 
which  are  quite  different  from  those  accommodating  the  large  objects.  Since 
the  total  number  is  limited  to  one  or  at  most  two  frequencies,  severe 
comparisons  are  forced.  It  would,  therefore,  be  expected  that  a less  con- 
straining  set  of  aircraft  may  provide  a better  performance  particularly 
when  a single  frequency  must  be  used. 
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